$\mathcal {S}^{2}$Net: Accurate Panorama Depth Estimation on Spherical Surface
نویسندگان
چکیده
Monocular depth estimation is an ambiguous problem, thus global structural cues play important role in current data-driven single-view methods. Panorama images capture the complete spatial information of their surroundings utilizing equirectangular projection which introduces large distortion. This requires method to be able handle distortion and extract context from image. In this paper, we propose end-to-end deep network for monocular panorama on a unit spherical surface. Specifically, project feature maps extracted onto surface sampled by uniformly distributed grids, where decoder can aggregate distortion-reduced maps. Meanwhile, cross-attention-based fusion module fuse skip connection enhance ability obtain context. Experiments are conducted five datasets, results demonstrate that proposed substantially outperforms previous state-of-the-art All related codes will open-sourced upcoming days.
منابع مشابه
Panorama Measurement Based on Spherical Projective Geometry
Previous panoramic studies focused on image stitching and the panoramic camera development. In recent years, people began to focus on panoramic scalability issues, the existed methods adopt traditional photogrammetric methods for data processing based on a multi-directional panorama images, using a large number of control points and combined bundle adjustment. Indeed, panorama itself is a kind ...
متن کامل3D Panorama Generation Using Depth-MapStitching
As the popularization and development of 3D display makes common users easy to experience a solid 3D virtual reality, the demand for virtual reality contents are increasing. In this paper, we propose 3D panorama system using vanishing point locationbased depth map generation method. 3D panorama using depthmap stitching gives an effect that makes users feel staying at real place and looking arou...
متن کاملDepth estimation from a sequence of images using spherical projection
A recursive estimation of depth from a sequence of images is proposed. Using the spherical projection, a simple equation is derived that relates image motion with the object motion. This equation is reformulated into a dynamical state space model for which Kalman filter can be easily applied to yield the estimate of depth. Point correspondences have been used to obtain feature points and the mo...
متن کاملACCURATE DEPTH−MAP ESTIMATION FOR 3D FACE MODELING (WedPmPO4)
In the past few years several systems for tridimensional face reconstruction based on the analysis of 2D images have been proposed. The main goal of these systems is to provide fast and reliable 3D information to face recognition systems. Nevertheless, nowadays, affordable systems that guarantees an high level of details and fast processing time using commercial devices are far from be realized...
متن کاملHighly Accurate Depth Estimation for Objects at Large Distances
Precise stereo-based depth estimation at large distances is challenging: objects become very small, often exhibit low contrast in the image, and can hardly be separated from the background based on disparity due to measurement noise. In this paper we present an approach that overcomes these problems by combining robust object segmentation and highly accurate depth and motion estimation. The seg...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2023
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2023.3234820